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[57] ABSTRACT 

A specific color field recognition apparatus and method are 
disclosed. A mechanism fetches a first image including a 
specific color and a second image with the specific color 
eliminated therefrom by picking up an image of an object 
having a specific color field to be recognized. A device 
produces a first density histogram and a second density 
histogram representing the number of pixels for each tone 
with respect to the first image and the second image, 
respectively. A converter determines a plurality of local 
maxima in the first and second images and converts the 
density of the first and second images in such a manner at the 
first image a background portion which is lowest density of 
the local maxima represents minimum of the gradation field, 
label portion which is highest density of the local maxima 
represents maximum of the gradation area, at the second 
image the background portion density represents lowest 
density of the gradation field, the letter density which is 
maximum of the local maxima represents a value which is 
inverted highest pixels of the local maxima of the first 
image. 

20 Claims, 9 Drawing Sheets 
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SPECIFIC COLOR FIELD RECOGNITION second images, respectively, first conversion means for 

APPARATUS AND METHOD detecting a plurality of first densities corresponding to local 

maxima from the first density histogram and converting the 

BACKGROUND OF THE INVENTION density of the first image into a third image in such a manner 

1 c* iA f th t 5 ^ at a roiairoum of the plurality of first densities represents 

1. titia oi tne invention ^ lowest density vahie Qf a ^ density histogram of tne 

The present invention relates to a specific color field third image and a maximum of the plurality of first densities 
recognition apparatus and method used with a mail process- represents the highest density value in the third density 
ing system for recognizing red areas such as postal number histogram, second conversion means for detecting a plural- 
frames or a postal franker mark printed or stamped on the 1Q ity of second densities corresponding to local maxima from 
mail surface from an image of such a mail. the second density histogram and converting the density of 

The present invention also relates to a specific color field second image into the fourth image in such a manner that 

elimination apparatus and method for producing an image a minimum of the plurality of the second densities represents 

lacking the specific color field recognized by the specific lowest '-^V °J a fourtt | I*"** .^togram of the fourth 

color field recognition apparatus and method. 15 ™ d A a third density which having maximum pixels of 

. J:j the second densities, represents a fourth density which is 

2. Description of the Related Art converted by thee first conversion means, the fourth density 
In a conventional technique for recognizing a specific having maximum pixels of the first densities; and means for 

color field used with a mail processing system, for example, recognizing the specific color field from the first image on 
red frames (postal number frames) or a postal franker mark the basis of the third image and the fourth image, 
in a letter image are recognized. With this technique, two 20 The recognition means further comprises means for sub- 
types of image signal are used. One, produced through a red tracting the fourth image by an offset value calculated on the 
filter, fails to pick up the red area, and the other picks up the basis of the density conversion ratio of the first and second 
red area. After the former signal is processed to thicken the density conversion means and binarizing the third image 
low-density portion, a predetermined offset value and a letter me resulting fourth image as a threshold level thereby 
base density signal are added to it. With the resulting signal 25 to detect the specific color field. 

as a threshold level, the image signal that has picked up the ^ present invention having the above-mentioned struc- 

red area is binarized by an analog signal processing, thereby ^re nas thc effects described below. More specifically, the 

discriminating the red area from areas of other colors. s P ecif j c colo [ field recognition apparatus and method 

A1 , j j • > < • , according to the invention are intended to remove the effect 

_ aiso, mere is an image signal proaucuon lecnmque nav- of defle< 5 ion of a density histogram due to a filter of a 

mg a high rate of red color elimination, in which the red ific ^ when ^ * c ^ ^ 

portion of an image signal not completely removed by a red ari m ori ^ nal im si / ^ an { si £ 

filter is replaced with a letter base density signal. ^ d mrough ^ gpecific colof ^ 

The conventional techniques described above however, fa Qther words> lhe backgroiind densit the lelter densil 

have the problem of a low allowance against the letter base and ±c UM deQsi in an ori ina] { and a dr 

color in view of the fact that the binarization conditions are ^ are ^ intQ consideration< ^ ori ^ im and 

not changed with the amplitude of the input image signal the drop-out image are converted in density to a new original 

which is varied with the color or density variations of the ^ and a new drop _ out image? respectively? in such a 

e er ase ' manner that at the first images the background density 
Also, since the thickening process is performed only 4Q represents the lowest density of a gradation and the label 
along the main scanning direction, the allowance is low density represents the highest density of the gradation, at the 
against the displacement in the subsidiary scanning direc- second images background image represents lowest density 
tl0n * of the gradation field, and the letter density represents the 
Further, the letter base density signal holds the maximum density inverted letter density of the first image. As a result, 
value of a letter image signal in the process of scanning 45 as shown in FIG. 4, the deflection of the density histogram 
along a scanning line. In the case where a label or the like for the drop-out image due to the filter is corrected, so that 
brighter than the letter base exists in the letter, therefore, the the original image and the drop-out image can be compared 
red area is erroneously recognized when the portion scanned faithfully with each other. Consequently, unlike in the con- 
after the label is processed, thereby leading to an erroneous ventional case of comparing a drop-out image with an 
red color elimination. 50 original image simply by adding a constant to the drop-out 

SUMMARY OF THF FMVFNmON ^ * in densit y a PP ro P riatel y in 

SUMMARY OF THE INVENTION accordance with the background, letter and label densities 

An object of the present invention is to provide a specific before comparison. A specific color field can thus be accu- 

color field recognition apparatus and method in which an rately recognized without being affected by the variations in 

allowance can be increased against the variations in the base 55 the background, letter or label density, 

or the color density of an object having a specific color field Furthermore, the above-mentioned recognition means 

to be recognized thereby to recognized and/or eliminate the performs the binarization a(cording. to the offset value 

specific color field with high performance and high quality. calculated on the basis of the density conversion ratios, and 

According to the present invention, there is provided a therefore the offset value can be set according to the 

specific color field recognition apparatus comprising means 60 background, letter and label densities. Even in the case 

for picking up an image of an object having a specific color where the background density changes or a specific color 

field to be recognized and outputting a first image including field of an envelope with a large, bright label, therefore, a 

the specific color, means for outputting a second image of stable field detection by binarization meeting various situ- 

the object to be recognized from which the information on ations can be realized according to the invention in which a 

the specific color is subtracted, means for producing a first 65 constant is not used for binarization unlike in the prior art. 

density histogram and a second density histogram represent- Additional objects and advantages of the invention wDl be 

ing the number of pixels for each density of the first and set forth in the description which follows, and in part will be 
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obvious from the description, or may be learned by practice as a postal number column printed in red on the surface 

of the invention. The objects and advantages of the invention thereof. Further, an address label 13 is applied on the surface 

may be realized and obtained by means of the instrumen- of the letter 11. The image also shows a background portion 

talkies and combinations particularly pointed out in the 14of the letter 11. The address label 13 normally constitutes 

appended claims. 5 a bright portion which is bright as compared with the base 

density of the letter 11. 

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1A shows a configuration of a specific color field 

recognition apparatus according to the present invention. 

Additional advantages and modifications will readily This apparatus comprises at least a video camera using a 

occur to those skilled in the art. Therefore, the invention in CCD imaging device as imaging means (hereinafter referred 

its broader aspects is not limited to the specific details, to merely as a CCD camera) for picking up an image of a 

representative devices, and illustrated examples shown and letter 11 as shown in FIG. 2. With this apparatus, a red field 

described herein. Accordingly, various modifications may be such as red frames 12 printed or stamped on the letter 11 is 

made without departing from the spirit or scope of the automatically recognized using two types of images includ- 

general inventive concept as defined by the appended claims ing a red drop-out image (second image), which has failed 

and their equivalents. 15 to pick up the red frames \2 or has picked up the red frames 

FIG. 1A is a block diagram schematically showing a but substantially difficult to discriminate from other colors, 

specific color field recognition apparatus and method and a non-drop-out image (first image) with the red frames 

according to an embodiment of the present invention; 12 P icked U P* In ^ description that follows, the red 

FIG. IB is a block diagram schematically showing the 20 J^ 0 * ^ mCam ™ T g V*? th K 

essential parts of a specific color field recognition apparatus n °f P l ^ d ^ °5 P lck * d ^ ^ dM t0 

and method according to an embodiment of the invention; A*™** from °* cr colors and the non-drop-out image 

° means an image with a specific color field picked up. 

FIG 2 is a diagram showing an image example of a letter fa nG ^ a red df fa si ^ and a nonKl 

constituting an object of recognition; . ■ . , . , A , . . v,^^ i A 4-, 

b J b ' out image signal picked up by imaging CCD cameras 20, 21 

FIG. 3 is a density histogram of an original image used for are converted into a digital image by an A/D converter 22. 

explaining a density detector; xh esc two types 0 f 

images are stored in an image memory 

FIG. 4 is a density histogram of an image after density 23 as original images and referred to as required in subse- 

conversion used for explaining a density conversion unit; quent processes. A density histogram production unit 24 

FIG. 5 is a diagram showing an example of a thickening 30 produces a density histogram representing the number of 

mask used for explaining a thickening unit; pixels for each tone of an image from the two original 

FIG. 6 is a diagram showing an example change of pixel ima S es stored in ^ ima S e mem °ry 23. 

values by thickening used for explaining the thickening unit; A density detector 25 detects the density of the base of the 

FIG. 7 is a diagram for explaining the manner in which a )" ttc K r U ™* b f Called ! hc ^"er base) the density of 

standard deviation is determined by a standard deviation 35 * he b !f^T d * I lactone 5 an image of the letter U and the 

calculation unit* density of the address label 13, if any, using the density 

m „ 0 . ' t . t histogram produced by the density histogram production 

FIG. 8 is a diagram showing the manner in which the tone un j t 24 

red U field a eco S ^ ■J™™ 8 USed f ° r ex P lainin e a Adensity converter 25 converts the density of the images 

recogni ion uni , ^ using the base density of the letter 11, the background 

FIG. 9 is a diagram for explaining the amplitude change density and the density of the address label 13. In the 

of a noise component caused by density conversion for the process, a non-drop-out image is converted in density in 

case of unity in magnification; such a man ner that the background density assumes a 

FIG. 10 is a diagram for explaining the amplitude change minimum tone value and also in such a manner that the 

of a noise component caused by density conversion for the 45 density of the address label 13 assumes a maximum value in 

case of k in magnification; the presence of the address label 13 and the base density of 

FIG. 11 is a diagram for explaining the relationship me letter H assumes a maximum value in the absence of the 

between the displacement and the recognition factor; address label 13. On the other hand, a red drop-out image is 

FIG. 12 is a flowchart for explaining the processing of a converted in density in such a manner that the background 

displacement correction amount detection unit; 50 defl sity assumes a minimum tone value and the base density 

™^ of the letter 11 assumes a corresponding value for a density - 

FIG. 13 is a diagram showmg an example of a red field . i , . . J 

v . . i jr i • • 5 c «j i- ■ * j converted non-drop- -out image. 

eliminating mask used for explaining a red field eliminated A ... , f; 1L . . & 4 . . . A A , 

image production unit; and u A thlckeiim S ™" 27 a P 0rtl0n lower in tone than 

J: , t the surrounding portion corresponding to the letters in the 

FIG. 14 is a diagram showing an example change of the 5$ red drop . out image in order to broaden the allowance of the 

pixel value by the red field elimination processing used for red field recognition unit 29 described later against the 

explaining the red field eliminated image production unit. displacement between the red drop-out image and the non- 

DETAILED DESCRIPTION OF THE drop-out image. 

PREFERRED EMBODIMENTS A standard deviation calculation unit 28 is for calculating 

60 the standard deviation of the base density of the letter 11 as 

Embodiments of the present invention will be described an index of the degree of the base density variations of the 

below with reference to the accompanying drawings. letter 11 for each of the two original images. 

Although the explanation refers to the case in which the a red field recognition unit 29 recognizes a red field by 

specific color is red, the invention of course is applicable binarizing the pixel values of the non-dropout image corre- 

with equal effect to other colors such as blue and green. 65 spending to those of the thickened red drop-out image with 

FIG. 2 shows an example image of a letter (mail) pro- each pixel value of the thickened red drop-out image less an 

viding an object of recognition. A letter 11 has red frames 12 offset as a threshold. 
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A displacement correction amount detector 30 is adapted non-drop-out image \> Y org ^ are determined in accordance 

to detect the displacement between the red drop-out image with equations (1) to (11) shown below for appropriate 

and the non-drop-out image using the number of pixels in density conversion. Further, the density is converted accord - 

the red field recognized by the red field recognition unit 29 jng lo toe magnifications M^, My, so that the images shown 

and determine the inter-pixel correspondence for binariza- 5 in FIG * 3 arc converted into images X>ynew as 

tion by the red field recognition unit 29. shown in mG - 4 In this wav > th e deflection of the drop-out 

* a a u v * * j • j *• •* it i image due to a filter or the like is corrected, and a detailed 

A red field eliminated image production unit 31 replaces J „• <. u a *• u ui 

4U • i i e *u a a * * /• * comparison with a non-drop-out image becomes possible, 

the pixel values of the red drop-out image corresponding to ~ 4 \ , f 4 - - \, , 

.i j £ ij . j * 4 u j c i j Furthermore, an onset value is subtracted from the drop- 

the red field recognized by the red field recognition unit 29 niU • „^ n ' , _ „ f . . • t - /co \ Thio 

L j ^1 f*u • Lt • i i, * i* m out image D^™ w for the purpose of bin anzation (89). This 

with the base density of the neighboring letter 11 As a result 10 ^ v * ^ e in lr / pr £ r aft fe fl0t a ^ant/but is 

the red field portions that could not be completely removed detC rmined according to equation (14) as a value corre- 

by an optical filter or the like can be rendered indistmguish- spondin g t0 the magnifications M y , used for density 

able from the case portion of the letter 11. conversion and the standard deviations (aY, aR of letter 

An image output unit 32 is for outputting a red field image density. With the drop-out image less the offset value 

and a red field eliminated image recognized by the appara- 1 as a threshold level, the binarization process is performed 

tus. A process controller 33 controls the components in (91) thereby to calculate the coordinate of the specific color 

general. field to be determined. 

Now, the processing operation of each component part The steps of this process will be described in detail below, 

will be described in detail. 2Q [ n the letter image of FIG. 2, the background 14 is black. 

The CCD cameras 20, 21 pick up a non-drop-out image This is an area of the smallest tone in the image, and in FIG. 

and a red drop-out image. A method of picking up a red 3, corresponds to a portion (background) 40 smallest in tone 

drop-out image is by using an optical filter that transmits among the three local maxima having a comparatively large 

only the red color to pickup a letter image. This method uses number of pixels. The base portion of the letter 11, which 

white light as an illumination. Instead of arranging a red 15 has the largest area but is irregular in tone due to the 

filter before the CCD camera, red light may be used for wrinkles or the like of the letter surface, corresponds to the 

illumination. The specific color, which is red in this peak or the neighborhood thereof of the portion (letter base) 

embodiment, is alternatively blue or green with equal effect. denoted by numeral 41 in FIG. 3. Further, in the case where 

Further, the means of picking up an image is not limited to an address label 13 or the like is attached on the letter 11, the 

the CCD camera as in the present embodiment but the 30 lone of the label portion is often higher than that of the letter 

vidicon or the like image pickup tube can also be used. base, with the tone values being concentrated at a peak or the 

The A/D converter 22 digitizes each analog image signal neighborhood thereof as denoted by numeral 42 in FIG. 3. 
picked up by the CCD cameras 20, 21 and converts it into These features are used to detect representative back- 
a digital image signal. The number of tones of the image is ground densities D YB , D^, representative letter base den- 
determined as required. In the case of this embodiment, 25 6 35 s *ties Dj^, and representative label densities D^, D^. 
tones of minimum 0 to maximum 255 are denned. Other For this purpose, while changing the tone value from mini- 
tone ranges of course are possible to use. m um to maximum, for example, from 0 to 255, local 

The image memory 23 has the function of storing digital maximaof the number of pixels included in a predetermined 

images and stores the red drop-out image and the non-drop- tone ™&™ recorded ; T*f *me range is predetermined so 

out image converted into a digital image by the A/D con- <o that a local ^— for the letter base > bm not kbel > 

verter. Various digital images generated in subsequent pro- assumes a lg es va ue. 

cesses are also stored and can be referred to as required. The Instead of this operation, a method may be used in which 

image memory 23 is configured of a semiconductor memory, local maxima are recorded progressively after smoothing the 

for example, and may have any other configuration of the waveform of a density histogram over an appropriate scale, 

same function. 45 m tQ is case, the smoothing scale corresponds to the prede- 

. - fTP t/x T ,_ . . t ~> A i n termined tone range. A tone value associated with the 

The density histogram production unit 24 produces a , . , . . , ° , , 

j •* u- * 4* <i_ i_ r ■ 1 r u highest local maximum value is used as a representative 

density histogram representing the number of pixels for each , 6 . ti . . t . r . , . 

* e *u a a t • j ,L I * • density of the letter base, and a tone value associated with 

tone of the red drop-out image and the non-drop-out image , ' . . ' ....... 

4 j • ,i • r * 1 r 4 l j T a local maximum lower than the representative letter base 

stored in the image memory 23. An example of the density , ^ . , ..... ^ 

, . . * .u ■ • u • rir^ i 50 density, if any, is assumed as a representative background 

histogram of these images is shown in FIG. 3. , ; V . . . r , ... , , & . 

° density. Also, a tone value associated with a local maximum 

Hie density detector 25 determines three types of density higher lharj ^ representative letter base density, if any, is 

representing the respective fields employed by the density employcd as a representative density of the address label 13. 

converter 26 for each of the red drop-out image and the ^ densi conyerler 2fi forms ^ followi conver . 

non-drop-out image using the density histogram produced 5S &ion ations for the representative densities of 

from the density histogram production unit 24. The three back ^ ound) the letter base and me kbel determined for the 

types of density include the density represenUng the back- ^ and lhe red dropout ^ by 

ground 14, the density representing the base of the letter 11 ^ dcnsi dctcctQr 2$ F{ ^ to ^ nQn . d 

and the density representing the portion of the address label QUt imag ^ lhe densities afe J according t0 eq ua- 

13, it any, shown in HG. 2. 6Q tions ^ (2)> ^ (4) and (5) bcbw in such a manner tha( thc 

A method of recognizing a specific color field according background density of an original image assumes a mini- 

to this invention will be described below with reference to mum tone value, say, 0, and the label density assumes a 

FIG. IB, etc. maximum value, say, 255. In the absence of the address label 

FIG. IB is a block diagram showing the essential parts of 13, conversion is made in such a manner that the letter base 
a specific color field recognition apparatus and method 65 density assumes a maximum value. In the process, the 
according to an embodiment of the invention. In FIG. IB, representative letter base density of the converted non-drop- 
magnifications 77, 79 of a drop-out image D RORG 73 and a out image is given by equation (6) below. 



07/14/2004, EAST Version: 1.4.1 



5,841,899 



My=(max. tonc-min. tone^DyL-Dyfl) 

YTMP 



(1) 

(2) 
(3) 



(where ^ytmp is included between min. and max. tone 
values) 

D KjV£VV «MLn tone (4) 

(where T>yt MP is less than min. tone value) 

D w£w =Max. 10116 ($) 

(where Dyy^p is larger than max. tone value) 



DrE.vffvvCDyE-D^xMyH-min. tone 



(6) 



where 

D YOJtG : density of non-drop-out image before conversion 
Dkvew : density of non-drop-out image after conversion 
^yenew* representative letter base of non-drop-out image 

after conversion 
DyL : representative label density of non-drop-out image 
D^: representative letter base density of non-drop-out 

image 

Dyg: representative background density of non-drop-out 
image 

My: magnification of non-drop-out image 

With regard to the red drop-out image, on the other hand, 
densities are converted according to equations (7), (8), (9), 
(10) and (11) in such a manner that the background density 
of the original image assumes the minimum tone value, and 
the representative letter base density (first specified value) 
assumes a value equal to the representative letter base 
density (second specified value) of the non-drop-out image 
after conversion. 



M R =(D YENEW -mm. tone v&hit)/(D REr D RB ) 
Vrtmp (D RORC -D RB )xM R +mm. tone value 

T> RffB w a ORTMf> 



CO 
(*) 
(9) 



(where D RTMl > is included between min. and max. tone 
values) 



D/t^v^-min. tone value 

(where D^^p is less than min. tone value) 

D^^^max. tone value 



(10) 



(where Dj^^p is higher than max. tone value) 
where D^^: density of drop-out image before conversion 
^rnew* density of drop-out image after conversion 
Dj^: representative label density of drop-out image 
Djt^: representative letter base density of drop-out image 
Dj^: representative background density of drop-out image 
M^: magnification of drop-out image 

As a result of the above-mentioned process emphasizing 
the letter image, erroneous detection of a red field is reduced 
even in the presence of the address label 13. The red field on 
the address label 13, as well as the red field on the letter base, 
can thus be positively detected. The magnifications of equa- 
tions (1) and (7) are used also for determining an offset used 
with the red field recognition unit 29. 

In the case where the density histograms of the non-drop- 
out image and the red drop-out image are as shown in FIG. 



8 



3, the density histograms after conversion are as shown in 
FIG. 4. If the density conversion unit 26 is combined with 
the red field recognition unit 29, the allowance is increased 
for the color and density of the letter base. As a consequence, 

5 only a red field can be recognized for letter bases of various 
colors such as blue, yellow and pink. In addition, a red field 
on the address label 13 can be detected. 

The thickening unit 27 sets the center of a 3x3 mask Ml 
on each pixel of the density-converted red drop-out image as 

10 shown in FIG. 5, and employs the smallest one of the pixel 
values of the positions 1 to 9 as a new pixel value. Although 
a square area of 3x3 pixels is shown as an example of a 
predetermined neighborhood, other shapes may of course be 
employed with equal effect. 

is FIG. 6 is a diagram showing the tone values of the pixels 
along a given scanning line. A waveform PI denoted by 
dashed line represents values before the thickening process, 
and a waveform P2 indicated by solid line values after the 
thickening process. This thickening process is intended to 

20 increase the size of the portion of the red drop-out image 
having a smaller tone value than the neighborhood on the 
one hand and reduce the size of the portion of the red 
drop-out image larger in tone value than the neighborhood 
on the other. 

25 This thickening process has the function of broadening 
the allowance against the displacement between the red 
drop-out image and the non-drop-out image for red field 
recognition, and also the function of reducing erroneous 
detection due to the individual displacement of each imaging 

30 device of the CCD cameras 20, 21. A similar effect is 
obtained also when an image other than a letter image is 
intended for. 

The standard deviation calculation unit 28 determines a 
standard deviation of the letter base density using a density 

35 histogram of an original image. The standard deviation of 
the letter base density is determined as follows, for example. 
FIG. 7 is a diagram for explaining the manner in which the 
standard deviation is determined. A bell-shaped waveform at 
and in the neighborhood of the letter base 43 in FIG. 7 

40 corresponds to the pixels of the letter base field and is similar 
to the shape of a normal distribution. 

Assuming that a normal distribution is approximated, 
therefore, neighboring densities around the waveform peak 
of a letter base density histogram associated with as many 

45 pixels as 1/K (K: predetermined constant) for the peak value 
are determined and are assumed to be Dal, D a2, respec- 
tively. From these densities, together with the peak density 
DE which is a representative letter base density, a value 
determined from equation (12) is assumed as a standard 

50 deviation a. 



a»((DE-Dol)+(Do2-D c ))2 



(12) 



where a is the standard deviation, DE is the representative 
letter base density, Dal is the density associated with as 

55 many pixels as 1/K for the peak value (Dal^^), Da2 the 
density associated with as many pixels as 1/K for the peak 
value (Do2>D £ ), and K is a predetermined constant. 

In the case where the shape of the peak is considerably 
different from the assumed normal distribution, i.e., in the 

60 case where the letter 11 has a pattern of a multiplicity of 
pixels with a density near to the letter base density, for 
example, the standard deviation determined by this method 
is not proper. In such a case, the standard deviation deter- 
mined is larger than the true standard deviation of the letter 

65 base density. Since the offset value used for the red field 
recognition unit 29 described later thus is larger than the 
proper value, the detection performance is deteriorated, but 
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without increasing the cases of erroneous detection. Other 
methods of calculating the standard deviation of course are 
also applicable. 

The red field recognition unit 29, as seen from equation 
(13) below, recognizes only a red field by binarizing the 
pixel values of the non-drop-out image corresponding to 
those of the thickened red drop-out image with each pixel 
value of the thickened red drop-out image less a predeter- 
mined offset as a threshold level. 

The manner in which the tone value changes along the 
direction of a given scan line is shown in FIG. 8. The right 
portion represents a specific color portion 60, i.e., a red field 
according to this embodiment. The left portion, on the other 
hand, indicates a field 61 darker than the surrounding fields 
other than a specific color field, i.e., a character field for the 
letter image according to this embodiment. The image may 
have some drop-out failure depending on the specific color 
to be recognized and the characteristics of the filter used for 
picking up the drop-out image. As far as the conditions of 
equation (13) below are satisfied, however, a drop-out color 
can be recognized. 

Although the present embodiment refers to the case in 
which the density conversion and the thickening process 
were performed on a specific color drop-out image and a 
non-drop-out image for binarization, a configuration lacking 
these processes of course is also possible. 

The offset for determining a threshold level has the effect 
of reducing the erroneous detection for binarization attrib- 
utable to the density variations caused by the noise compo- 
nents of the image. The amplitude of the noise component of 
the image is substantially proportional to the standard devia- 
tion of the pixel value of the letter base portion. 

D<D lM -O fiet (13) 

where D is the pixel value of a non-drop-out image, D th is 
the pixel value of a specific color drop-out image, and Offset 
is an offset. 

As shown in FIGS. 9 and 10, the amplitude of the density 
variation component depends to a large measure on the 
magnification difference for density conversion. The offset 
value, therefore, as shown by equation (14), is determined 
by the magnification for density conversion and the standard 
deviation of the letter base density. As a result, even in the 
case where the density variations of the letter base portion 
are large or the contrast of the original image is small with 
a large magnification for density conversion, the red field 
with a small chance of erroneous recognition can be suc- 
cessfully recognized. It is of course possible to detect a 
specific color field by a similar method also for a specific 
color other than red. 

OffsetoM^CPxaY+QHM^RxcrlUS) (14) 

where magnification of the non-drop-out image 

M R : magnification of the red drop-out image 

ctY: standard deviation of letter base density of non-drop-out 

image 

aR: standard deviation of letter base density of red drop-out 
image 

P, Q, R, S: a predetermined constant 

The displacement correction amount detector 30 auto- 
matically detects the displacement amount between the red 
drop-out image and the non-drop-out image, and changes 
the pixel correspondence for binarization at the red field 
recognition unit 29, thereby reducing the effect of the 
displacement. FIG. 11 shows a change of a recognition 
factor which is the number of pixels of a red field recognized 
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when the two types of image described above are displaced 
along a given scanning line. In many cases, the recognition 
factor assumes a minimum value in the absence of 
displacement, and tends to increase with the displacement 

s amount. This is due to the fact that the red field erroneously 
recognized increases with the degree of displacement. 

In view of this, a displacement range is predetermined by 
the steps shown in the flowchart of FIG. 12 (SI), and the 
displacement amount is changed within this range while the 

10 red field is recognized repeatedly (S3, S5), thereby deter- 
mining a displacement amount associated with a minimum 
recognition factor (S7). The displacement amount associated 
with a minimum recognition factor may fail to coincide with 
an actual displacement amount depending on the original 

15 image. The displacement can be corrected appropriately, 
however, by performing the above-mentioned processing on 
a plurality of original images and using the resulting average 
value. 

This displacement correction is automatically performed 
20 at the time of starting or during the operation of the 
apparatus. Intervals between adjusting jobs can thus be 
lengthened, thereby leading to a labor saving. A similar 
effect of course can be obtained for a specific color other 
than red. 

25 The red field eliminated image production unit 31 
replaces the pixel values of the red drop-out image corre- 
sponding to the red field determined by the red field recog- 
nition unit 29 with the neighboring letter base density. In the 
case where the neighboring field is other than the letter 

30 image, the pixel values are replaced with those of the 
particular neighborhood of the specific color field. As a 
method of determining the pixel values to be replaced, as 
shown in FIG. 13, the center of a 3x3 mask M2 is set on a 
pixel of interest, and the average value of the pixels satis- 

35 tying equation (15) other than the pixel of interest is 
determined and assumed to provide a new value of the pixel 
of interest. In the case where the mask M2 contains no pixel 
satisfying equation (15), the pixel values are replaced by 
those of the representative letter base density. 

40 Representative letter base density-p<pixel value< 

representative letter base density+ (15) 

where p is a predetermined constant. 
Although the present Embodiment refers to a square of 

45 3 x3 pixels as an example of a predetermined neighborhood, 
other shapes of course equally apply. In the case where the 
neighborhood is not the letter image, the pixel values 
representing the field around the specific color field is used 
instead of the representative letter base density. As a result, 

50 an image is produced in which the red portion that was so far 
difficult to remove completely by an optical filter or the like 
is indistinguishable from the letter base. 

The image output unit 32 has the function of displaying on 
the screen of a CRT display the red field eliminated image 

55 and the recognition result of the red field providing an output 
of the apparatus, or transferring the processing result to other 
systems for performing various processing taking advantage 
of the processing result of the intention. 
Applications using the recognition result of the red field 

60 and the red field eliminated image include the detection of 
the orientation of the letter or the detection of a field having 
a character using various red fields including the postal 
number frames printed on the letter. 
The present invention of course is applicable to the 

65 recognition of a specific color field other than the red field. 
For example, the position of a specific-color component in 
a image taken on various parts is detected as an application. 
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As described above, according to this embodiment of the 
invention, the operation and functions described below are 
expected. 

(1) In the case where the present invention is applied to a 
letter image, the density representing the background, the s 
density representing the letter base and the density repre- 
senting the address label are determined using the features of 
the density histogram of the letter image. The density 
conversion specific to each density is performed to improve 
the performance of red field recognition. 10 

(2) As a result of performing the density conversion 
described above, the allowance can be enlarged against the 
color density differences of an object having a specific color 
to be recognized, while at the same time making it possible 
positively detect the red field on the address label. is 

(3) The thickening process is performed not only in one 
direction but in two-dimensional fashion, and therefore the 
allowance against the displacement can be increased. 

(4) For recognition of a specific color field, the offset 
value used for binarization is made variable in accordance 20 
with the standard deviation of the object density and the 
magnification used for density conversion. Therefore, the 
allowance is increased against the base density variations or 
the color density differences of the object surface including 
the specific color of an object to be recognized. In applica- 25 
tions to a letter image, for example, the offset value applied 
for binarization is made variable in accordance with the 
magnification for density conversion and the standard devia- 
tion of the letter base density. As a result, the allowance 
against the variations of the letter base density and the color 30 
density differences of the letter base. 

(5) When producing a specific color field eliminated 
image, the density of the neighboring pixels or the density 
representing predetermined neighboring pixels is used, and 
therefore the quality of the specific color eliminated image 35 
can be improved. In the case where the invention is applied 

to a letter image with a red specific color, for example, the 
red field eliminated image production unit uses the neigh- 
boring letter base density or a representative value of the 
letter base density as a replacement value. The quality of the 40 
red field eliminated image, therefore, is considerably 
improved. 

(6) Provision of the displacement correction amount 
detector facilitates the work of adjusting the apparatus while 

at the same time lengthening the time intervals between 45 
adjustments. 

As described in detail above, according to the present 
invention, there is provided a specific color field recognition 
apparatus and method, in which the performance of specific 
color field recognition is improved, while at the same time 50 
increasing the allowance against both the displacement as 
well as the difference in the color and density of an object 
having a specific color field. 

Also, according to the present invention, there is provided 
a specific color field elimination apparatus and method 55 
which can considerably improve the quality of a specific 
color field eliminated image. 

Additional advantages and modifications will readily 
occur to those skilled in the art. Therefore, the invention in 
its broader aspects is not limited to the specific details, 60 
representative devices, and illustrated examples shown and 
described herein. Accordingly, various modifications may be 
made without departing from the spirit or scope of the 
general inventive concept as defined by the appended claims 
and their equivalents. 65 

What is claimed is: 

1. A specific color field recognition apparatus comprising: 



means for picking up an image of an object having a 
specific color field to be recognized and outputting a 
first image including the specific color; 

means for outputting a second image of the object to be 
recognized from which information on the specific 
color is subtracted; 

means for outputting a first density histogram and a 
second density histogram representing the number of 
pixels for each density of the first image and the second 
image, respectively; 

first conversion means for detecting a plurality of first 
densities corresponding to local maxima from the first 
density histogram and converting the density of the first 
image to a third image in such a manner that a mini- 
mum of the plurality of first densities represents the 
lowest density of a third density histogram of the third 
image and a maximum of the plurality of first densities 
represents the highest density of the third density 
histogram; 

second conversion means for detecting a plurality of 
second densities corresponding to local maxima from 
the second density histogram and converting the den- 
sity of the second image to a fourth image in such a 
manner that a minimum of the plurality of the second 
densities represents the lowest density of a fourth 
density histogram of the fourth image, and a third 
density which having maximum pixels of the second 
densities, represents a fourth density which is con- 
verted by the first conversion means, the fourth density 
having maximum pixels of the first densities; and 

means for recognizing the specific color field from the 
first image on the basis of the third image and the fourth 
image. 

2. A specific color field recognition apparatus according to 
claim 1, wherein the first conversion means includes; 

means for detecting from the first density histogram the 
first density value with the number of pixels represent- 
ing a local maximum and smallest in density value as 
the density of the background lacking the object, the 
second density value with the number of pixels repre- 
senting a local maximum and higher than the first 
density value as the density of the portion representing 
the object, and the third density value with the number 
of pixels representing a local maximum and higher than 
the second density value as the density of the portion 
brighter than the object; and 

third conversion means for converting the density of the 
first image and outputting the third image in such a 
manner that the first density value assumes the smallest 
density value of a third density histogram of the third 
image and the third density value assumes the highest 
density value in the third density histogram; 

and wherein the second conversion means includes; 

means for detecting from the second density histogram 
the fourth density value with the number of pixels 
representing a local maximum and smallest in density 
value as the density of the background lacking the 
object, a fifth density value with the number of pixels 
representing a local maximum and higher than the 
fourth density value as the density of the portion 
representing the object, and a sixth density value with 
the number of pixels representing a local maximum and 
higher than the fifth density value as the density of the 
portion brighter than the object; and 

fourth conversion means for converting the density of the 
second image and outputting the fourth image in such 
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a manner that the fourth density value assumes the 
smallest density value in the fourth density histogram 
and the fifth density value represents value which is 
converted second density value by the third conversion 
means, 

3. A specific color field recognition apparatus according to 
claim 2, wherein the third conversion means includes: 

fifth conversion means for converting the density of the 
first image and outputting the third image in such a 
manner that the second density value assumes the 
highest density value in the third density histogram in 
the absence of the third density value. 

4. A specific color field recognition apparatus according to 
claim 1, wherein the recognition means includes; 

means for reducing the fourth image by a offset value 
calculated on the basis of the first and second density 
histograms and binarizing the third image with the 
fourth image as a threshold level thereby to detect the 
specific color field. 

5. A specific color field recognition apparatus according to 
claim 1, wherein the recognition means includes; 

means for reducing the fourth image by the offset value 
calculated on the basis of a density conversion ratio of 
the first and second conversion means and the standard 
deviation of a density of the object, and binarizing the 
third image with the fourth image as a threshold level 
thereby to detect the specific color field. 

6. A specific color field recognition apparatus according to 
claim 1, wherein the first and second conversion means 
include; 

means for calculating the magnifications desirable for 
conversion and converting the first image and the 
second image into the third image and the fourth image, 
respectively, by linear transformation corresponding to 
said magnifications. 

7. A specific color field recognition apparatus according to 
claim 1, further comprising; 

means for thickening an image thereby to correct the 
image properly with respect to the fourth image. 

8. A specific color field recognition apparatus according to 
claim 1, further comprising; 

means for comparing the positions of the first image and 
the second image and, upon detection of a displacement 
between the two positions, eliminating the displace- 
ment by changing the correspondence between the third 
image and the fourth image for binarization by the 
recognition means. 

9. A specific color field elimination apparatus comprising; 
means for picking up an image of an object having a 

specific color field to be recognized and outputting a 
first image including the specific color; 

means for outputting a second image of the object to be 
recognized from which the information on the specific 
color is subtracted; 

means for producing a first density histogram and a 
second density histogram representing the number of 
pixels for each density of the first image and the second 
image, respectively; 

first conversion means for detecting a plurality of first 
densities corresponding to local maxima from the first 
density histogram and converting the density of the first 
image to a third image in such a manner that a mini- 
mum of the plurality of first densities represents the 
lowest density in a third density histogram of the third 
image, and a maximum of the plurality of first densities 
represents the highest density of the third density 
histogram; 



1,899 

14 

second conversion means for detecting a plurality of 
second densities corresponding to local maxima from 
the second density histogram and converting the den- 
sity of the second image into the fourth image in such 

s a manner that a minimum of the plurality of the second 
densities represents the lowest density value in a fourth 
density histogram of the fourth image, and a third 
density which having maximum pixels of the second 
densities, represents a fourth density which is con- 

ao verted by the first conversion means, the fourth density 
having maximum pixels of the first densities; and 
means for recognizing the specific color field from the 
first image on the basis of the third image and the fourth 
image; and 

15 means for eliminating the specific color field recognized 
by the recognition means from the first image. 

10. A specific color field elimination apparatus according 
to claim 9, wherein the elimination means includes; 

20 means for eliminating the specific color field by replacing 
the image of the specific color field of the first image 
with the image of the neighborhood of the specific 
color field. 

11. A specific color field recognition method comprising 
25 the steps of: 

forming an image of an object having a specific color field 
to be recognized and outputting a first image including 
the specific color; 

outputting a second image of the object to be recognized 
30 from which the information on the specific color is 
subtracted; 

producing a first density histogram and a second density 
histogram representing the number of pixels for each 
density of the first image and the second image, respec- 

35 tively; 

a first conversion step of detecting a plurality of first 
densities corresponding to local maxima from the first 
density histogram, and converting the density of the 
first image into a third image in such a manner that a 

40 minimum of the plurality of first densities represents 
the lowest density value of a third density histogram of 
the third image, and a maximum of the pluralities of 
first densities represents the highest density value in the 
third density histogram; 
a second conversion step of detecting a plurality of second 
densities corresponding to local maxima from the sec- 
ond density histogram and converting the density of the 
second image into a fourth image in such a manner that 

50 a minimum of the plurality of the second densities 
represents the lowest density value in a fourth density 
histogram of the fourth image, and a third density 
which having maximum pixels of the second densities, 
represents a fourth density which is converted by the 

55 first conversion means, the fourth density having maxi- 
mum pixels of the first densities; and 
recognizing the specific color field form the first image on 
the basis of the third image and the fourth image. 

12. A specific color field recognition method according to 
60 claim 11, wherein the first conversion step includes; 

a substep of detecting from the first density histogram the 
first density value associated with the number of pixels 
representing a local maximum and smallest in density 
value as the density of the background lacking the 
65 object, the second density value associated with the 
number of pixels representing a local maximum and 
higher than the first density value as the density of the 
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portion representing the object, and the third density 
value associated with the number of pixels representing 
a local maximum and higher than the second density 
value as the density of the portion brighter than the 
object; and 5 

a third conversion substep for converting the density of 
the first image and outputting the third image in such a 
manner that the first density value assumes the smallest 
density value of a third density histogram the third 
image and the third density value assumes the highest 10 
density value in the third density histogram; 

and wherein the second conversion step includes; 

a substep of detecting from the second density histogram 
the fourth density value associated with the number of 
pixels representing a local maximum and smallest in 
density value as the density of the background lacking 
the object, a fifth density value associated with the 
number of pixels representing a local maximum and 
higher than the fourth density value as the density of the 2Q 
portion representing the object, and the sixth density 
value associated with a number of pixels representing 
a local maximum and higher than the fifth density value 
as the density of the portion brighter than the object; 

and 25 

a fourth conversion substep of converting the density of 
the second image and outputting the fourth image in 
such a manner that the fourth density value assumes the 
smallest density value in the fourth density histogram 
and the fifth density value represents value which is 30 
converted second density value by the third conversion 
substep. 

13. A specific color field recognition method according to 
claim 11, wherein the third conversion step includes; 

a fifth conversion substep of converting the density of the 35 
first image and outputting the third image in such a 
manner that the second density value assumes the 
highest density value in the third density histogram in 
the absence of the third density value. 

14. A specific color field recognition method according to 40 
claim 11, wherein the recognition step includes; 

a substep of reducing the fourth image by the oflset value 
calculated on the basis of the first and second density 
histograms, and binarizing the third image with the 
fourth image as a threshold level thereby to detect the 45 
specific color field. 

15. A specific color field recognition method according to 
claim 11, wherein the recognition step includes; 

a substep of reducing the fourth image by the oflset value 
calculated on the basis of the density conversion ratio 50 
of the first and second conversion steps and the stan- 
dard deviation of the density of the object, and bina- 
rizing the third image with the fourth image as a 
threshold level thereby to detect the specific color field. 

16. A specific color field recognition method according to 55 
claim 11, wherein the first and second conversion steps 
include; 

a substep of calculating the magnifications desirable for 
conversion and converting the density of the first image 
and the second image into the density of the third image 
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and the fourth image, respectively by the linear trans- 
formation according to said magnifications. 

17. A specific color field recognition method according to 
claim 11, further comprising; 

a step of thickening an image thereby to correct the image 
properly with respect to the fourth image. 

18. A specific color field recognition method according to 
claim 11 , further comprising; 

a step of comparing the positions of the first image and the 
second image, and upon detection of a displacement 
between these two positions, eliminating the displace- 
ment by changing the correspondence between the third 
image and the fourth image for binarization in the 
recognition step. 

19. A specific color field elimination method comprising 
the steps of: 

forming an image of an object having a specific color field 

to be recognized and outputting a first image including 

the specific color; 
outputting a second image of the object to be recognized 

from which the information on the specific color is 

subtracted; 

producing the first density histogram and the second 
density histogram representing the number of pixels for 
each density of the first image and the second image, 
respectively; 

a first conversion step of detecting a plurality of first 
densities corresponding to local maxima from the first 
density histogram and converting the density of the first 
image to a third image in such a manner that a mini- 
mum of the plurality of first densities represents the 
lowest density in a third density histogram of the third 
image, and a maximum of the plurality of first densities 
represents the highest density of the third density 
histogram; 

a second conversion step of detecting a plurality of second 
densities corresponding to local maxima from the sec- 
ond density histogram and converting the density of the 
second image into a fourth image in such a manner that 
a minimum of the plurality of the second densities 
represents the lowest density value in a fourth density 
histogram of the fourth image, and a third density 
which having maximum pixels of the second densities, 
represents a fourth density which is converted densities 
by the first conversion means, the fourth density having 
maximum pixels of the first densities; 

recognizing the specific color field from the first image on 
the basis of the third image and the fourth image; and 

eliminating the specific color field recognized in the 
recognition step from the first image. 

20. A specific color filed elimination method according to 
claim 19, wherein the elimination step includes; 

a substep of eliminating the specific color field by replac- 
ing the image of the specific color field of the first 
image with the image of the neighborhood of the 
specific color field. 
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